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Abstract 

Standard statistical methods applied to matrix random variables often 
fail to describe the underlying structure in multiway data sets. In this 
paper we will discuss the concept of an array variate random variable and 
introduce a class of elliptical array densities which have elliptical contours. 

1 Introduction 

The array variate random variable up to 2 dimensions has been studied inten- 
sively in [3 and by many others. For arrays observations of 3, 4 or in general 
i dimensions a suitable normal probablity model has been recently proposed in 
[1] . In this paper we will generalize the notion of elliptical random variables to 
the array case. 

In Section 2, we first study the algebra of arrays. In Section 3, we introduce 
the concept of an array variable random variable. In section 4, the density of 
the elliptical array random variable is provided. Then, in Section 5, we define 
the array random variable with elliptical density. 



2 Array Algebra 

In this paper we will only study arrays with real elements. We will write X to 
say that X is an array. When it is necessary we can write the dimensions of 
the array as subindices, e.g., if X is a mi x m2 x 7713 x dimensional array 
in /j™ix"i2x...xmi^ then we can write Xm1y.m2xm3y.m4- Arrays with the usual 
elementwise summation and scalar multiplication operations can be shown to 
be a vector space. 
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To refer to an element of an array Xmixm2xm3xm4,, we write the position of 
the element as a subindex to the array name in parenthesis, {X)r-^r2r3r4,- If we 
want to refer to a specific column vector obtained by keeping all but an indicated 
dimension constant, we indicate the constant dimensions as before but we will 
put ':' for the non constant dimension, e.g., for Xmixmixmaxrrn, {X)r^r2:ri 

refers to the the column vector {{X)rir2lr4, {X)rir22r4, • • • , {X)rir2m3r4y ■ 

We will now review some basic principles and techniques of array algebra. 
These results and their proofs can be found in Rauhala [4], [5] and Blaha [2]. 

Definition 2.1. Inverse Kronecker product of two matrices A and B of dimen- 
sions p X q and r X s correspondingly is written as A & B and is defined as 
A'Si'' B = [A{B)jk]prxqs ^ B ® A, where '(8)' represents the ordinary Kronecker 
product. 

The following properties of the inverse Kronecker product are useful: 

• & A = A<g}' = 0. 

• {Ai + A2) & B ^Ai& B + A2 & B. 

• A& (Si +B2) = A&Bi+A & B2. 

• aA & /3B = a/3A & B. 

• (Ai & Bi){A2 & B2) - A1A2 & B1B2. 

• {A& B)-^ = [A-^ & B-^). 

• {A& B)^ = & B^); where A'^ is the Moore-Penrose inverse of A. 

• {A & B)^ = {A^ (E)^ B^), where A~ is the ^-inverse of A defined as 
A- = {A'A)-^A'. 

• If {Ai} and {^ij} are the eigenvalues with the corresponding eigenvectors 
{xi} and {Vj} for matrices A and B respectively, then A & B has eigen- 
values {XifJ-j} with corresponding eigenvectors {xi & y^}. 

• Given two matrices Anxn and B„ix,n \A & B\ = tr{A & B) = 
tr{A)tr{B). 

• A& B = B ® A ^ UiA® BU2, for some permutation matrices Ui and 1/2- 
It is well known that a matrix equation 

AXB' = C 
can be rewritten in its monolinear form as 

A®' Bvec{X)^vec{C). (1) 
Furthermore, the matrix equality 

A (g)* BXC' = E 



2 



obtained by stacking equations of the form ([T]) can be written in its monolinear 
form as 

{A & B & C)vec{X) = vec{E). 

This process of stacking equations could be continued and R-matrix multiplica- 
tion operation introduced by Rauhala [4; provides a compact way of representing 
these equations in array form: 

Definition 2.2. R-Matrix Multiplication is defined elementwise: 

^rni Xm2X ...XmiJqiq2...qi 

mi m2 rris 

ri — 1 r2 — 1 r3— 1 ri—1 

R-Matrix multiplication generalizes the matrix multiplication (array multi- 
plication in two dimensions)to the case of /c-dimensional arrays. The following 
useful properties of the R-Matrix multiplication are reviewed by Blaha [5] : 

1. {AYB^AB. 

2. {Ai)^A2fC^AiCA'^. 

3. y = (/)■'?. 

4. {{AjYiA^f . . . {A,y){{Bry{B2f . . . {B,y)Y = {AjBiYiA^B^f . . . {AB.yY. 

The operator rvec describes the relationship between Xrn,ixm2x...mi and its 
monolinear form Xmim2...miXi- 

Definition 2.3. rvec{Xmixm2y ...mi) — Xrn,im2...miXi where x is the column 
vector obtained by stacking the elements of the array X in the order of its 
dimensions; i.e., {X)j^j^,,,j. = {x)j where j = (ji — l)ni_i7ii_2 . . . + {ji — 
2)ni-2ni-3 . . .ni + . . . + {j2 - l)ni + ji. 

Theorem 2.1. Let L,n^xm2x...mi ~ (^1)^(^2)^ ■■• (^i)*-'^ where (Aj)^ is an 
mj X Uj matrix for j = 1, 2, . . . , i and X is an ui x 712 x . . . x array. Write 
1 = rvec{L) and x = rvec{X). Then, 1 = Ai ®' ®* . . . (g)* AiX. 

Therefore, there is an equivalent expression of the array equation in mono- 
linear form. 

Definition 2.4. The square norm of Xmixm2x...mi is defined as 

mi m2 mi 

ii=ij2=i ji=i 

Definition 2.5. The distance o/Xi„jjx„j2x...mi fi^om X2mixm2x...mi defined 
as y^||Xi-X2||2. 

Example 2.1. Let Y = {Ai)'^{A2)'^ . . . {A,yX + E. Then is minimized 

forX = {A-,f{A^f...{ATyY. 
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3 Array Variate Random Variables 

Arrays can be constant arrays, i.e. if {X)rir2...ri € R are constants for all rj, 

j = 1,2, . . . , TUj and j = 1,2, . . . ,i then the array X is a constant array. 

Array variate random variables are arrays with all elements {X)r^r2...ri S 
random variables. If the sample space for the random outcome s is S, 

{X)rir2...ri = {s))rir2...ri whevs sach of {X {s))rir2...ri is a real valucd function 

from Sjo M. 

If X is an array variate random variable, its density (if it exists) is a scalar 
function fx{X) such that: 

• fxi^) > 0; 

• J^.f^{X)dX = l; 

• P{X G A) = f^[X)dX, where A is a subset of the space of realizations 
for X. 

A scalar function y{X,Y) defines a joint (bi-array variate) probability 
density function if 

. f^y{X,Y)>Q; 

• k!xfxyi^^^)dXdY = 1; 

• P{{X, y) g A) = / y{X, Y)dXdY, where A is a subset of the space 
of realizations for {X,Y). 

The marginal probability density function of X is defined by 

fxiX) = J^fx,YiX,Y)dY, 

and the conditional probability density function of X given Y is defined by 

where fyiY) > 0. 

Two random arrays X and Y are independent if and only if 

f^^yiX,Y) = f^{X)fyiY). 

Theorem 3.1. Let (^i)"'^, (^2)^, {^iY be mi, TO2, rrii dimensional 
positive definite matrices. The Jacobian J{X — ^ Z) of the transformation X = 
{A^)\A2f...{A,rZ + M IS 
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Proof. The result is proven using the equivalence of monolinear form obtained 
through the rvec{X) and array X. Let imixm2x...mi = (^1)^(^2)^ ■•• (^i)*^ 
where {AjY is an mj x nj matrix for j — 1,2, ... ,i and X is an rii x n2 x ... x rii 
array. Write 1 = rvec{L) and z — rvec{Z). Then, \ — Ai & A2 & . . AiZ. The 
result follows from noting that J(l — > 2;) = |Ai®*A2®'. . .&Ai\~'^, and using in- 
duction with the rule = for n x n matrix A and m x m matrix 
Bto showthat \A^®' . A^\-^ = {\A^\^^*^"'^ \A2\^'*'''"' . . . |A,|njV. -"^ 

□ 

Corollary 3.1. Let Z - /^(Z). Define X = (^1)1(^2)^ • • • {Ai)'Z + M where 
(Ai)^, (^2)^, . . . , (^i)* "^2, . . . ,mi dimensional positive definite matrices. 

The pdf of X is given by 

f (X-(A (A (A Y m - fi^i'yi^^'f ■ ■ ■ (AT'TiX - M)) 

The main advantage in choosing a Kronecker structure is the decrease in the 
number of parameters. 

4 Array Variate Normal Distribution 

By using the results in the previous section on array algebra, mainly the rela- 
tionship of the arrays to their monolinear forms described by Definition [53], we 
can write the density of the standard normal array variable. 

Definition 4.1. // 

Z ^ N^-^ Xm2 x...xmi {M = 0, A = Imim2...mi): 

then Z has array variate standard normal distribution. The pdf of Z is given by 

exp(-|||Z|p) 

(27r)'"i'"2---nii/2 ' 

For the scalar case, the density for the standard normal variable z S is 
given as 

6-1 (z) = rexpi — z^). 

^ ^ ' {2^)h 2 ' 

For the mi dimensional standard normal vector z G R™i , the density is given 

by 

(t>m^iz) = ^ exp{--z'z). 
(2tt) 2 z 

Finally the mi x m2 standard matrix variate variable Z g j^mixm2 j^g^g ^j-^g 
density 

<Prmxrn2{Z) = - — -^Y^exp{- -trace{Z' Z)). 
{2tt) 2 Z 

With the above definition, we have generalized the notion of normal random 
variable to the array variate case. 



/ (z) = ^"^v; . (2) 
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Definition 4.2. We write 



ni2 ■ ..nii 



ifrvec{X) ^ Nmim2...mi{rvec{M), Kmim2...mi)- Here, M is the expected value of 
X , and Amim2...mi is the covariance matrix of the mim2 . . . rrii-variate random 
variable rvec{X). 

The family of normal densities with Kronecker Delta Covariance Structure 
are obtained by considering the densities obtained by the location-scale trans- 
formations of the standard normal variables. This kind of model is defined in 
the next. 

Theorem 4.1. Let Z ^J^,nixm2x...xm,{M = 0, A = /mim2...mj- Define X = 
(Ai)^ {A2)'^ . ■ . {AiY Z + M where Ai, A2, . . . , Ai are non singular matrices of 
orders mi, m2, . . . ,mi. Then the pdf of X is given by 

exp (-ill(A-i)^(Ajif . . . {A-'YiX - M)f) 



(t){X-M,Ai,A2,...A,) = 



(3) 



Proof. The result is easily obtained using the density in Definition 14.21 with 
Corollary EH □ 



5 Array Variate Elliptical Distribution 

A spherically symmetric random vector x has a density of the form f{x'x) for 
some kernel pdf f{t), defined for t S R+. 

A stochastic representation for the random vector x is given by a; = ru, 
where r is a nonnegative random variable with cdf K{r) that is independent 
of u which is uniformly distributed over the unit sphere in R'^, denoted by S'^, 
where r = ^ylx'x), u = —J^ — . If both K'{r) = k(r) S K the pdf of r, and 

f{x'x) the pdf of X exist, then they are related as follows: 

Hr) = (4) 

Some examples follow: 

1. The standard multivariate normal Nk{Ok,Ik) distribution with pdf 

1 ^L^'^ 



(27r)'=/2 



2. The multivariate spherical t distribution with v degrees of freedom with 
density function 



fix) 



r(iw)(w7r)'=/2 (1 + ia;'a;)("+'=)/2 
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3. When v = 1 the multivariate t distribution is called spherical Cauchy 
distribution. 



The array variate random variable with spherical contours is defined using 
the relationship between the array and its monolinear form. This amounts to 
saying that the density of the array variable X is spherical if and only if it can be 
written in the form for some kernel pdf f{t), defined for t S R"*". The 

elliptically contoured random variables with unstructured covariance matrices 
can be obtained by applying a linear transformation to the monolinear form of 
an array variate spherical random variable. 

In general we can define an array variable random variable with unstructured 
covariance matrix, i.e. we can say X has array variate distribution if rvec{X) has 
elliptical distribution. Array variate densities with elliptical contours that have 
Kronecker delta covariance structure are also easily constructed using Corrolary 

Definition 5.1. Let Ai, A2, . . . , Ai be non singular matrices with orders toi, 
TO2, mi and M be a miX TO2 x ... xto^ constant array. Also, let m = 
mim2 . . .vrii. Then the pdf of an nii x 7712 x . . . x elliptically contoured array 
variate random variable X with kernel pdf f(t), t > is 

For example, the following definition provides a generalization of the multi- 
variate t distribution to the array variate case. 

Definition 5.2. Let Ai, A2, . . . , Ai be non singular matrices with orders mi, 
7712, ■ • • , and M be a miX m2 x . . . xmi constant array. Also, let m = 
777.17712 . . ■ rm. Then the pdf of an miX 7*72 x . . . xm^ array variate t random 
variable T with degrees of freedom v is given by 

fjf; M, A., A.., . . . ^0 ^ + \ui^nA,r . ■■iA-y(f - mrr^^^-y^ 

where c^ (..)'"/-r((^p)/2) ^ 

Distributional properties of a array normal variable with density in the form 
of given by Theorem l4.1l or a array variate elliptical random variable with density 
of the form in (15.11) can obtained by using the equivalent monolinear represen- 
tation of the random variable. The moments, the marginal and conditional 
distributions, independence of variates can be studied considering the equiv- 
alent monolinear form of the array variable and the well known properties of 
the multivariate normal random variable and the multivariate elliptical random 
variable. 
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